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/ - * • 

As a result of experience in training local districts to use State 

0 / . 

Assessment results* staff of khm Michigan Educational Assessment Program 

uS . ' J ' 9 

i— i (MEAP) have developed procedures for helping school district and building 

t-H / \ 

^yj staffs use and report assessment results. There are procedures for using 

1 , i results at the district level, school building level and classroom level 

(see Appendix A). This model of using and reporting test results is 

t 

applicable to other state programs that are faced with the challenge of 

teaching local educators to use their results. As was discussed in an % 

earlier paper*, these ideas came from observing schools that made use of 

the results, so they are ba*ed on realistic estimates of resources. available 

locally* 

, Assumptions 

The use and reporting model is predicated on several assumptions. First, 
it is assumed that we believe that our test results should be used to help 
students learn. That is, we believe that what we test is Important and local 
'educators should teach students the skills ^hich thfy have not already * 
attained. Second, it is assumed that we believe that parents, taxpayers, 
board members and othsr members of the public have a right to know about 
their schools. Therefore, measures of schools such as test scores should be * 
provided to these groups in a context which helps them underitand the meaning 
<5o of the scores. Third, most Ideal educators (teachers, administrators, 

%^ counselors and so forth) are npt well trained in testing, and those who have 

* Development of Siaple Wajys for Using Stats Aasassaent Results - Presented at the 
, Tenth Annual Large Scale Assesssttnt Conference, June, 1980. 
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had course* on te.ting were taught how te .t. ere conetructe d end how to 1 
xeed te .t report., not u?e the reeult. in inetruction. Fourth, without 
'training end motivation to uee re.ult., many loc.1 educator. will Ignore r 
' the result!^ Thl. mean* that trainer, met actively pursue training 

• * activities and motivate l5cal educator, to implement the training. 
" V Nation can take many form, and the assessment program .t.ff .hould use 

both positive mean, and .voldance of negative consequence, to motivate local 

• • locators. Fifth, there are .1^1. way. of using te.t reeult. and these can 
„ be taught to local educator.. That is, significant use of tp,*** be made 

by teacher. ,nd principal, without additional training or the use of outside 
experts. Finally, the use of the re.ult. by the teacher, and the principal 
end the reporting of thVre.ult. at the> district level to the school board 

• * and media, and at the building level to the parents are very much interrelated. 

T.ltlM Abou t th. 8«»ul«Ji ^ 

ItMy ...«odd fob.gln . dl.cu..lon of u.lng .nd reporting result. «Uh 
. d..crlptlon Of to r*or« too. - .ft.r .11. ho. ,.n « report .o»ething 
th.t « heven't d«t.mln.d the «.nlng oft Wh.t do report* Yet, lnv.ri.bl,. 
loci .doctor, report the te.t, re.ult. without detaining -n.t the, ne.n or 
• • »».t .111 b. done .. . con.«,uenc. of th... So,,, loci eductor. », e»en 
believe ttat reporting the r..uft. U the u.e of the.. 

,ou co r.cogul.. th... dl.trict. quit. ...U,. The, .re the one. th.t 
;.port .cor., to th. loc.1 herd, the new. ™dl.. th. loc.1 p.rent group, or 
oth.r .udl.nc. in t.r- of or lo..... p.rc.ntll. cub. or oth.r nomntlv. 

• .«,„!..... I-provln, .cor..* of .bo* .v.r.g. Vcor.. .r. ^.h..l..d. .nil. 
"* th. u.. of th. cult. 1. lpor.d. th. flr.t p.>o. to .hv. th. .cor.. 

^.d or -t -U b. don. to l^ro«.th- fu«h.r 1. flm to dljcovr thet 
9 ,n. di.«rict-l«.l or .ch«,l-lr™l offlcUl h.. no r..l ld« .bout the 
£££ ,1-lfW. °< th. r..ult. _ *, th.,' .r.'.o high or 1« .nd -at c.n be don. 

. •'•■•3 



to improve thee. Districts with declining scores or below average results 
try to shun publicity, hoping to avoid the negative iaage such results will t 
bring, the test reports of these districts are so thin thst even the un- 

» 

trained lay citisea can see through them. 

Using Teat Results 

What can be done to improve reporting? Improve the uae pf the reaulte! 
The active ateps .to u#e the results will improve the reporting of the results 
as well. , The use of results provides a context for the reports of results — 
the "meat" of the reports. 1 

There are two major ways to use assessment results at the building level. 

The first, is to use the results to help tt*e students that are tested. Assuming 

\ 

that the test covers a representative set ot skills and that the skills are 
realistic expectations for the students, the skills that students do not attain 
can provide a starting place for planning instruction. In order to do this 
most effectively, ichool staffs need to be taught that the instructional needs 
of students may not be always discernable from the skills that the student misses. 
These nay tmly be Indicators of underlying instructional needs* Some local 
districts (and states) have assisted this process by developing instructional 
support materials "that include "diagnostic" tests to determine needs and in- 
structional suggestions keyed to the different levels which students may be 
operating on. Supporting instructional materials are also presented < 

The second way of using the rest results is for curriculum review and - 

t — 

instructional planning at the building level-. Ideally, the building principal . . 
and all classroom teachers (at all grades) will participate as a building *ea»., 
A three-step process was developed in Michigan to guide school staffs In using 
tests for this purpose (See Appendix B-l, 2 and 3). Step one is the determination 
of which skills', tested present the greaft^t instructional need. Step two is the 



identification of current instruction on these. (and th$ other) skills at 
each of the previous grade levels* This may take the form of time spent on 
each skill* when during the school year that the instruction occurs, what 
text and other jtaterials are used to teach the skills &nd so forth. Step 

• • « - • 

thrp£ is the {tetermirtatlon of immediate and longer terns curricula goals. 

DutrjLng the final step, staff will determine what changes in Instruction 

• « 
should be made. If skills that students do poorly on are ones on which they 

9 I * 

have n6t received sufficient instruction, when should students receive 
additional instruction? When should the skill be introduced, reinforced and 
reviewed? Usually, these activities can be fit into normal instructional 
activities. On the othej hand^on which skills can Instructional time be 
reduced? If students are doing suite well, is excessive rediftdancy built 
into instruction? If so, this time can be used f or the needed additional 
(or other) instruction. 

The major direct benefit of this process is that teachers apd the princi- 
pals will have established a plan to use the test results — a short-term plan 
for the students tested and a longer-term plan to modify curricula to meet 
student needs before they are tested. Indirect benefits of this prpcess* 
include: a coordinated instructional, plan, a feeling of team participation 
among teachers, and increased communication ajpong administrators, teachers, 
parents and students. 

V 

Reporting of Results 

Once the school has determined how the results will be used, reporting the 

r 

resylts makes more sense?. Parents of students tested can be told by the class** 

room teacher what fcyiedial instruction is planned* Parents of students not in 

\ 

the test group can be told* how the school curricula will be modified to improve 

*l ' * 

student achievement (See Appendix C). Citizens can be Informed what the school 



\ 
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la trying to do, how well. the school Is doing It, and what will be done to 
Improve It. Thla la particularly of intereet to achool board members. snd 
other cltizeiu (Saa Appendix D) . 

The plan for reporting teat results has three major parte. The flrat la 
to prepare the audience with Information about the purpoae of the program, 
how the -result* are being used and how the acorea fit within the context of 
Sther Information about the district or achool. The background report, 
adapted, from reporting £o the newe media, worka equally well with "other 
sudiences auch aa the achool board, patent groupa and other lay audlencee. 
/ The purpoae of these presentetlons Is to prepare the group to understand 

( 'the results^ Because teatlng la unfamiliar to moat lndlvlduala, preparation 

-^.^ 

is^needed to understand the reports*. If acorea are glvert out before the 
explanation la given, the group la less' likely to heer and comprehend the 
message — their attention will be diverted XA the numbers and what they 
mean. Aleo. a message which la given twice (before and aa acorea are reported) 
la more likely to be heard and understood. m ^ 

The background report should contain the baalc facta of the assessment 
program* and some sample teat Item*. It might be Intereatlng to adminleter a j 
few eample teat Itema to thlgroup to giver them a "realletlc" idea of what 
the teste" are like. In edditlon, the report should help the audience under- 
stand the relatlonehlp (or lack thereof) between outcome* aa melaured by 
teeta or other meane and inputs , auch aa instructional materials , ataff and 
flnancea. Perhapa moat Important, the report ahould atreaa what haa been and 
will be done with the reaulta. Thla ahould be deacrlbed In aa concrete terms 
aa poaeible, perhapa by having teachara report their vlane. Some buildlnge 
that have been through the procees deacrlbed earlier could be used. Finslly, 
the background report should conclude with the plen for the subsequent reports, 
so the group knows that more information, will be coming. 



The second type of report le the actual report of the, test results. 

9$ * 

This report should he nade in the simplest and briefest terms possible, 
emphasizing the^u^e Sf audiovisual materials. Five key questions should 
be addressed* 

A. How did We do this year? ' 

B. Did achievement improvf over last year? 

« * * • 

C. If so, why? o 

D. If not, why not? g i 

E. What will be done to review and use the results? 

It is as important (if- pot more so) to discuss low results or declining 
scores as it is high or improviag scores. The negative story will get out 
and its important to acknowledge it and be prepared to 'do something about it f . 

The final type of ^P^J t 18 the follow " u P report. This report; is used to 
inform the group of action taken or d^fiieions made subsequent to the background 
-'report or the report of the results. This report may focus on specific curri- 
cula selected for revieV, results of this review process, new instructional- 
activities implemented as a result of the review or special activities 'imple- 

I as a result of testing — awards, summer remedial programs , and po forth. 
Than planning the campaign to use and report the test results, it may be 
useful to -think in terms uf the events which must be carried out. Appendix E 
shows s<W of the major events which take place before", during and after 
testing and the reporting activities connected with 4ach testing activity. 
Also shown is a sample schedule for the reporting activities and a list of 
audiences who are interested/concerned about the test results. By planning 

.the use and reporting of test scores in advance, users can more firmly tie 

* 

the use and reporting together. ' 

/ 



Local educators often -state their lack of training or the lack of 
tine or money aa excuses for not uaing and reporting results. These 
activities for reporting and uaing teat scores have been developed with 
these constraints in mind. The reporting of assessment scores is dependent 

t 

on the use of the scores, but *ach activity reinforcea the other. When 

* 

professional staff take the time to determine meaning c * the scores, the 
resultant insight can form the basis of reports of the results to many 
audiences: By increasing tlie level of knowledge of various professional 
and lay groups, support for the schools* Instructional programs Is increaaed. 

c 

Thua, testing can serve aa a vehicle to both improve educational opportunitiee 
of etudentjs and communicate what is good about schools (and our commitment 
to change what ian. 9 t so good) to varioua important audiences. State assess- 
ment program staffs can help local districts learn theae simple techniques. 
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SECTION II 



t APPENDIX A 



USING MEAP TEST RESULTS 



In this section, a number of suggestions will be given concern- 
ing the uses of MEAP results. For the sake of convenience these 
uses have been grouped at the district, school, and individual 
student levels. This arbitrary means of subdividing a coordinated 
school district and building effort to use the tests results was 
adopted to point out the different responsibilities of district-level, 
school-level, and classroom personnel. A number of resource 
materials have been developed to assist local educators in using 
and reporting MEAP results. A list ofjhese resources and instruc- 
tions for acquiring them are given in Appendix F. 



District Level Use 



What Should Be Done? 



District officials should 
• Provide leadership and direction to the staff; 



• Interpret MEAP test results as they relate 
district program; and 



t^^fotal 



• Communicate results in this context to the school board 
and the community at large. 



Why? 



• The interest of district-level administrators and curricu- 
lum specialists will encourage building-level adminis- 
trators and teachers to use assessment results. 

• The importance of interpretation cannot be over- 
emphasised. The educational assessment program pro- 

* vides a large amount of information. Teachers, principals, 
and other district personnel should reach an understanding 
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of what the assessment data means to them. In the absence 
of an "official interpretation, newspaper .reporters, 
citizens, parents, or students will provide their own mean- 
ings of the data. If these interpretations are improper or 
based on limited information, they may be. difficult for 
school personnel to correct 

• ' The manner in which MEAP test results are shared by 
district officials will have a significant impact on the over- 
all usefulness of the results. Act, donlreact 



How Is Leade 



rsnTp 



And Direction Provided To Staff? 



• Distribute school level assessment results to school staff ' 
o> promptly. 

, 4 

(I V 

• Hold one or more briefings for central office staff and 
school staff to present and discu88*results in detail. 

I Emphasize what has been accomplished and what should ' 
be addressed. 

* In larger districts, it may be useful to hold school-by- 
. school briefings for entire professional staff during 
which district and the specific school results are dis- 
cussed. What the district plans to do with the results 
and expects the school to do stfould also be communis 
cated. 

• Encourage school staff to use schooTlevel MEAP results 
and to distribute the Pamphlet for Parents. 

How Can Results Be Related To Total Progrant? 

• Examine district MEAP results to determine how students , 
performed. 

♦ 
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• Examine and compare the results of other district-level 
measures of achievement. 

• Prepare a written report which includes the complete 
assessment results. Highlight both the strengths and weak- 
nesses. The report should also include interpretations, 
implications, and the plan of action. Make the report avail- 
able to anyone who wants to understand or analyze the 
MEAP results in depth. 

• Prepare a presentation which gives the total picture of the 
district's instructional and evaluation programs showing 
MEAP within the context of other testing done in the 
district. 

How Should Meap Test Resu!^ Be Communicated To Various 
Audiences? 

• Determine the audiences to whom the information should 
be communicated and what they would be most interested 
in knowing. These audiences will probably include admin- 
istration and school staffs, parents, tnedia representatives, 
and the community at large. 

• Adjust the emphasis, length, and content of the presenta- 
tion to make it meaningful and clear to the audience being 
addressed. , 

• For the school board: 

* The board will want to be shown the strengths and 
weaknesses in overall student performance. The district 
can present the objective by objective results contained 
in the District Summary, highlighting strengths and 
weaknesses. 



As areas for improvement are identified, preliminary 
plans for correcting deficiencies should be presented. 
The board can then identify priority ar,eas and consider 
possible reallocations of district resources. 




* Plan and adapt your board presentation accordingly. 
For the community at large: 

* Capitalize on public interest— past experience has 
shown that the public reporting of MEAP test results 
generates a tot of interest. Take advantage of this 
excellent opportunity to improve public relations. 

* Act, donl react— release MEAP test results prbfnptly 
and in the context of your total school program- Report 
early, report honestly, report fully, and provide infor- 
mation about what the district/school is doing to make 
achievement even better. This should reducf occasions 
when reaction to negative newspaper reports are 
necessary- Let the public know how you are doing on 
the assessment tests and more importantly, what you' 
are doing in your schools to give students a quality 
v Jucation. ' 

* Prepare a brief, clear release which can be used by the 
news media. Photographs of students actively engaged 
in learning are excellent ways to show the positive 
aspects of schools.. 

* Initiate an ongoing dialogue with the media to keep 
them informed of what is going on in the district during 
the course of the Entire year. 

e 

* Respond to all inquiries in a positive, honest manner. 
Even if the results are less than "glowing", acknowledge 
needs openly and indicate the plans for improvement or 
st* r s that are already underway to correct deficiencies- 
Be *ure to mention areas which have shown improve- 
ment over a period of time. 

L . . 

* ,Use the MEAP presentation as an opportunity to 
generate parents' interest in their children's educa- 
tional progress. Awareness of the larger school environ- 
ment and the context in which testing is done helps to 
enlist school support. 

1 V 



• A manual entitled "Presenting ME AP" has been developed 
to assist districts in reporting results to the school board 
and the general public. The manual outlines twenty steps 
that can be taken to explain the proper uses and limits of > 
MEAP. The manual also suggests how to report district 



MEAP results and how to look for and find other interest- 
ing elements of the school district programs, which when 
reported, help give a truer picture of district performance 
(er of the school district) See Appendix F. 



THINGS TO K£EP IN MIND WHEN INTERPRET**^ MEAP TEST RESULTS 



1. In the Objectives, the word "wOT is either need or implied. 
This dees not mean that the state is mandating that the student 
wlU do something or must, by Department edict, learn a particu- 
lar bit of information. The use of the term "will" simply means that 
as a demonstration of .objective attainment, a student will be able to 
6V> What » stated in the objective. 



1 The performance objectives assessed by the test hems are 
amfaUcaal objectives. Therefore, these objectives do not cover the 
entire range of skills that educators wmdd consider important for 
many students to know in mathematics and reading at the begin- 
ning of fourth, seventh and tenth grade. In addition, local school 
districts may have other important objectives which are unique to 
the local district 

t 

%^ & Only selected objectives from the total set of minimal 
performance objectives in mathematics and reading are tested 
Therefore, educators should not assume, that students have 
attained all minimal objectives, even if they attejffcd all objectives 
tested this year. * / 
J. ■ * 

» ^ 

* - if "4 The minimal performance objectives are * guide to expec- 
tailpeafarsteMlsntp 

of the objectives until later than may be the usual case. 



Individual stu 
interpreting 





it characteristics should be kept in mind when 
results to parents. 



The criterion for objective attainment was set by the State 
of Education. Local educators may feel that for some 
objectives, or some students, the criterion is too high or too tow. 
This should be considered when interpreting results. n 

6. Low scores on the assessment test should not be regard m 
an indication that a school or classroom is inefficient or uninspiring 
to students. Low scores are an indication that there are educational 
needs present However, tow scores do not say what caused these 
needs. 



ldtfe 



7. Test results and performance objectives should do" related 
to tht instructional materials and curriculum being used in the 
school the student/is attending. Parents should be made aware of 
the context in whfch the testing has been done. Awareness of the 
larger school environment should help understanding of student 
performance by the parent 

8. Explain to parents the role they can play in their child's 
education. The minimal performance objectives and MEAP 
test results are being explained to them for the benefit of their 

..child's education. 



8chool Level Use 



Much h known about the use of test results to improve student 
achievement Appendix D, for example, lists several major 
principles that research has shown are related to improved school 
achievement Because achievement occurs at the classroom and 
school building levels, though, the building principal and all class- 
room teachers determine the extent to which test results are used to 
help students. Models for using and reporting ME AP and other test 
results have been developed. These methods were developed in 
schools and are based on realistic resource constraints. Schools 
have used these models in the past and each is described in this 
section. Attending to specific curriculum and instructional needs is 
the job of all teachers, not just the fourth, seventh and tenth grade 
teachers. 



Why Use MEAP? 

• MEAP test results provide valuable information on the 
, status of basic skills education in schools. 

• MEAP is a reliable vehicle for imnroving the educational 
quality of each Michigan public school and benefits all 
students, both individually and collectively. /"* 

• MEAP helps detect trends and patterns in the performance 
of students. 

• MEAP helps match skill needs with curriculum and in- 
structional programs. 

• MEAP helps teachers focus directly upon the minimum 
skill needs of students. 

• MEAP helps teachers plan group and individual instruc- 
tion. 

ERIC 15 



Who Should Be Involved? 



• The Schoo? Principal should provide the leadership and 
direction in this team effort 

• School personnel should use MEAP test results to help 
address the following areas of concern: 

* Identify the skill needs of Students tested. 

* Review the curriculum and instructional programs. 

* Establish insteuctionaT priorities for the school year. 

* Involve parents in the educational process.' 

• Parents can use the MEAP results to determine the child's 
progress in acquiring basic math and reading skills. 



How Should The Principal Provide Leadership And 
Direction? 



• The principal's major responsibilities are to: 

i * Hand out test results to staff promptly. 
/ * Organize and direct the MEAP School Utilization 

' Team. 

* Show enthusiasm and concern for the improvement 
of student achievement 

* Give assistance and support to the staff in their efforts 

to enhance the school curriculum and instructional 
programs. 

* Report school test results and a proposed plan' of 
action to parents. 
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Hew Should The School Team Use MEXp Results?^ 

• The school team'i major responsibilities are to: 

* Explore staff expectations of the stfidents. 
Examine test results to identify problems and needs. 

* Conduct,* curriculum and instructional program re- 
v (*jc viw to determine current strategies used to teach the 

skills that are tested. 

* Make decisions* set goals and devise a plan of action to 
address needs (based upon findings). 

e The ME AP School Utilization Team should include at least 
one representative from each grade level and/or curricu- 
lum area, as well at each area of support services. 

* . 

* In small school*, full staff participation is feasible. 

* In large schools, grade-level teams (K-3, 4-6, 7-9) may 
be a better alternative. 

e The emphasis qfthe team should be on people pulling to* 
gather in an agreed-upon direction to determine needs. 

e A positive approach is needed to assure that changes 
agreed upon are implemented with care and concern for 
improvement. 

• Instructional changes can be made most easily when the 
school staff is involved in the change. 

• Two-way communication is important and everyone snould 
be aware of what everyone else is doing, in terms of what, 
where and when skills are taught, what needs each per- 

s ceives, and finally, how each can help the other. 

What Resource* Are Available For The* If Effort? 



o Materials have been developed to help school staffs use 



HEAP test results. They are easy to use and can be adapted 
for use in different types of schools. 

* A flyer entitled "Principals and Teachers: The 
Building Team^has been included in the School 
Coordinator's Manual. This is a good introductory 
document for staff. It provides suggestions on what 
should be done before, during an J after the tests are 
administered. 

* The MEAP Curriculum Rwiew Model can be put 
into operation in three sessions. For each session, the 
goals, materials needed, and approximate time and 
process agenda are outlined. The first setr.ion deals 
with examining the results, identifying the skills of 
greatest concern and setting a realistic criterion 
level The second session reviews the curriculum and 
instructional program to determine what is current- 
ly being done. The last session is a decision making, 
goal setting activity to improve the student attain- 
ment of the basic skills. 

* Objective matrices are helpful analysis tools. The 
matrices list each objective in reading and mathe- 
matics for grades four, seven, and ten. They have 
multiple uses, such .as prioritising objectives, 
examining the instructional program (what is 
taught— when, where, and at what grade level) and * 
addressing needs (reference text books, grad* levsi 
programs, etc.). 

* The MEAP Parent Reporting Model provides sugges- 
tions for staff preparation, three ways of distributing 
the MEAP Pamphlet for Parents, and reporting the 
test results. Each model contains the goals, materials, 
anticipated time, participants, and outlines the steps 
to be taken. 
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— Model A, Individual Parent/Teacher Confer- 
ence*, is recommended. It personalizes the re- 
sults, provides for two-way communication, and 
gets parents involved. '* 

— Model B, Group PTA Meetings, has the advan- 
' tage of putting MEAP into the larger context of 

the total school program. 

— Model C t to mail or send the Pamphlet for 
Parents home with the student is the least desir-. 
able method of reporting. Howeyer, something is 
better than nothing when communicating with 
parents. 

A sample ME API PTA Meeting has been prepared in 
an open-ended script format It includes what should 
be said, by whom, when, Mat should be done, and how 
long it should take. 

The film "Building Better Basics: The Home School 
Partnership" should be useful in any parent-teacher 
meeting, school board meeting, or other community 
meetings. This 12-minute film was designed for 
parents to encourage them to take an interest in their 
children's education. 
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STEPS THE SCHOOL T«AM MAY WANT TO ' | 
CONSIDER WHEN USING MEAP TEST RESULTS , s 

1. Using the School Summary Report, examine objective 
attainment levels. . „ ' 

2. Using the Feeder School Report, examine the objec- 
tive attainment lereb of stuefcnts who w 

the boilding. " < 

. 

J. Establish an acceptable criterion level of a ttainment 

4. List in priority order all objocUTea(frum buth thcSehool 
Summary Report and the Feeder School Repert)laU- 
ing below the acceptable criterion level set in 03. 

6. Determine whert the MEAP objectives are currently 
being taught in theiiistri»ctk)e^s«|u«^intbebuiloV 
ing and what instructional materials -are used. 

6. Identify the present needs. 

7. Make decisions, set goals, and outline a plan of action. 
Share the plan with the full staft 

8. Initiate a plan of action. . ' 

9. Set up an evaluation mechanism. 
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hscuvfciual Student Use 

Hew cm MEAP Test Results Be Used To Help Individual 
Students Tested? ^ 

e The responsibility of using MEAP test result* to focus 
attention on the specific minimal skill needs of individual 
students falls "do different staff members in different 
school situations (grade level teachers, content area 
teachers, counselors, etc): 

* IneieroenteiTsehoobthisresponsibility it most fre- 
quently that of the fourth teachert. 

A 

* In secondary schools thi/ responsibility is often not 
assumed by, nor assigned to, anyone. If, however, 
individual students are to receive needed help, the 
responsibility must be assigned and carried out 

• e Before using MEAP teat results to help an individual 
student, the following questions should be answered: 

* What are the MEAP objectives? (reading and mathe- 
matics, grades four, seven, and, ten.) 

* Are the objectives tested part of the curriculum in 
earlier or later grades? 

\ * Where are the objectives introduced, taught, re- 

viewed? 

* Which objectives are most important, at this point 
in time, for this student? 

* What is the best approach to instruction? 

e The same steps outlined in the MEAP Curriculum Review 
Mcdd can be applied whet using the individual student 
and classroom data. The results must be examined and 
needs identified (using the Clsssranm Listing Report and 

ERIC 4 4 
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the Individual Student Report), criterion levels deter- 
mined, curriculum reviewed, and goals set, etc 

What Resources Are Available For Helping Individual 
Students Tested? 

• The flyer entitled "Understanding and Using the Indi- 
vidual Student Report* explains why the test was given, 
what the report means, and how the results can be used to 
identify skill weak n ess es . It can be used by teachers in 
conferences with students and parents, h can also be used 
by students examining their Individual Student Report 
independently. The flyer can be removed from the 
handbook and duplicated (see Appendix E). 

e The instructional support materials can be'used as a tool * 
to inservice local personnel or as a resource by. individual 
teachers. . * 

* MATHEMATICS: Five areas of instruction (Frac- 
tions, Decimals, Ratio and Proportions, Percent and 
Whole Number Computation) have been addressed 
in two sets of mathematics materials. These materials 
were prepared to assist teachers whose students are 
having difficulties in one or more of these areas. 

* READING: For grades 4 and 7 the support materials 
contain information about areas of reading which 
caused problems for students on the MEAP tests. A 
pending addition to these materials will provide 
instructional ideas for the current reading objectives. 

The secondary level support materials identify a 
process for disseminating MEAP reading results to 
various departments in a high school. These materials 
include examples of reading objectives and instruc- 
tional procedures and strategies within content areas. 

. * Other: Materials have also been developed in other 
subject areas and specifically for secondary schools 
(see Appendix F). 
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m % • APPENDIX B-l 



SCHOOL PREPARATION FOR A OTILIZATION OF 
HEAP TEST RESULTS WORKSHOP' 



i; Things to be Consider* Whtn Flannlni a Utilisation Workshop 

\ 1. Tht school unit is a key element in the .utilisation 

1 *f aiMMMit data. 

2. Tht emphasis is on having ptoplt pull togtthtr in an 
agreed upon direction. 

3. Instructional changaa can bt made s»et easily whan the school 
staff is involved in the changes. 

4. Soliciting full staff participation however, is easier 
•eld -than done, \ 

5. The department has developed a MEAT teet results 
utilisation aodel which is adaptable to aost situations, 
and certified 2 IRA trainers are available to conduct workshops, . 
upon request. 

6. The MEAP utilisation model can* be put Into operation in 3 
sessions which involve from 2H to 4 hours.. Of course, it 
Includes an uncalculated amount of individual: effort. 

-# 

XI. Organising a School 'team 

A* Sise - will vary depending upon building sire and/or method 
used to select team members. 

B. Participants - x 

(1) Should includs at leaet a repreeentatlve sample 

(2) "If poesible, the pntire staff should be involved. 

III. Things to be Considered in Organising a MEAP Utilization School Tean 

1. Organisational structure of the school 

2. Contrectual agreements, ss to meeting times and lengths 

3. Preliminary information sessions with key support personnel 
(such as: administrators, depertment chairpersons, curriculum 

specialist, remediel specielist, sssist principsls, etc.) 
k. Who vill conduct meetlng(s) 

5. How the team membership will bs determined— a) msndstory, 

b) voluntery, c) other 

6. How many team members sre needed? The^school team should 
include st least a representetive cross section of the 
staff (i.e., 1-sdninistrstor, 1-tescher, l-currieu!««n 
spscialist, etc.) 

7. Staff-Faculty sttitude toward testing— a) negative, b) positive, 

c) neutral* d) no knowledge 

8. Brief description of proposed activity st total staff- 
faculty meeting. 

9. Team meeting date, place and time. 

IV. Materials Necesssry (Provided by Rcqueiting School) 

1. Copies for ssch team member— e) School Summery, b) District 
Summary, c) State Summary 
O 2. Classroom Listing Report for 4th, 7th and 10th grads tsschsrs 

ERJC 3. MEAP Handbooks (for reference) 
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A MODEL V FOR 
UTILIZATION OF HEAP TEST RESULTS 

Session t 

Examining Respite and Identifying Present Needs 

O03J.S : 

In terms of basic skills attainment in Reading and Math: 

1. School teams will be abl* to read, understand and interpret 
MEAP test results forms. ' / 

2. School teams will be able to determine where the school 
stands in rslation to their district and state. 

3. School teams will be able to make a realistic criterion 
selection* 

, # 

4. School teams will be able to identify school problem 
areas and determine present needs. 



^iti*rlals: (Copies fijr Everyone) 

School Summary Report 
District Summary Report 
State S unary Report 



Time : x 

1-2 hours. ' 
Croup Site : 

1. Will vary, dependent uport: staff size, method of selection* 

2. Should Include: 

f (a) Total instructional staff (if possible). 

(b) Principal and 1 Teacher per grade (minimum). 

(c) A large Building Team could be subgroupsd (K-3 t 4-6, 7-9). * 

Process: 

1. Introduce activity briefly, explaining goals of the activity. 
(Thess could be vrltften on a chalkboard, on transparencies or 

on news print . ) . * 

2. Review types, format and content of report forms. 

3. nonpars to District Summary /Tor general information and to 

4. Compare to State Summary establish a frame of reference, 

7 n<Vt to establish ^neids In comparative 
Itjtrms. 



APPENDIX B-4 

A MODEL FOR / 
CURRICULUM S. PROGRAM REVIFW USING MEAP TEST RESULTS 

Session II 

Curriculum and Instructional Planning ?f- 

,••'*"'" 

Goals : \ N , 

I. School teJms wilt examine present school needs of 4th, 7th, and lOth^rpfccra, 

summarized from previous meeting. , ' 

2.. Teachers will complete objective matrix to determine present status of building- 
wide curriculum and instructional program. 
3. Building teams will identify which objectives are school-wide priority and 
which are individual classroom priority. 

Materials : (copies for everyone) 
* Summary of Present Heeds and School Criterion Levels 
Blank matrix sheets for each participant (matrix for reproduction) 
Classroom Listing Reports for 4th, 7th, and 10th grade teachevs 
MEAP Handbook (optional) 

Time : 

1*2 hours 

« * 

Group Sixe : 

Building Teams 

Process : 

1. Introduce activity briefly, explaining goals of the activity. 

2. a. 4th, 7th, and 10th grade teachers examine Classroom Listing Report to find 

priority objectives, f 

b. All other teacher, c&plete objective -trta. Matrix ™l"Pl« «»" s 
DHour. per year taught 2)Prioritize 1-5 3) Introduce/teach/review 
4)Reference text book, etc. There should be a correlation between 
time spent and attainment. Collect and make composite of results, 
examples: record all times and average each grade, make a composite 
for each grade, etc' Be surs to differ.nciate between teach/learn. 

3. Chairperson collects objective matrices and assigns responsibility of com- 
pletion and reproducing for next meeting. 

4. Determine whether or not 4th, 7th, and 10th grade classroom prioritiss are 
the same as the .school priorities. 

5. If necessary, building team examine. MEAP Handbook to determine whether or 
not students have appropriate skills to attain the objectives as meaaured 
by the specific items. 

6. A decision must bm made as to the allocation of special attention to be given 
to objectives In the school and in the classroom. 

7. The \buildimg team may want to distributs the objectives across grade levels. 
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APPENDIX B-5 



Team assignment: In preparation fcr the next •••ting, principal and teachers 
m£ c"leTr..ourc.\oformation on priority objective, e.g. vhat textbook 
tumuli." supplementary uttrMi, games, etc. are available for focused 
attention! anything nel, unique, or different on eny priority objective. . 
The. individual matrices muct be collected, co-piled into k composite, *** 
coJieVof the composite picture mad. for each t*e. —ber f or th, next meeting 
This tssk shouldbe definitely assigned. Separate composits for grades K 3,\ 
4-6, or 7-9 may be helpful in schools with large grade spans. 
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A MODEL FOR , 
"^RRICULUM « PROGRAM REVIEW USING MEAP TEST RESULTS 

Seeslon III 
Decision Making - Setting fcoals 

Goals: i 

1. Building teaa will examine objective matrfiTcomposlte to determine teaching 
priority devoted* to various objectives. 

2. Building teaa will sake decision to change (or not change) school curriculum 
or Instruction program. 

3. Building team will font a plan of action for work on school and classroom 
f - objective priorities—short term end long term. 

4.. Bunding team wllUshare^fcindings about lnatructlonal sources and methods. 
5. Building team will determine the need for "outside" assistance. 

Materials ; 

Composite objectives matrix(s) (copies for everyone) 
School Summary Reports (from Session I) * 

# • . > y 

Tlme ; - ~ , ' 
1 hour 

* • 

Gf_pu_ Size: * 
* Building team 

Process: 

1. Introduce activity briefly, explain goals. 

fTHand'out the objective matrlx(s), and note objectives which have high priority 
and low priority, In terms of amount of Instructional time allocated, etc. 
' J. Have building team examine objectives prevloualy selected as short term and. 
long tec* priorities. " \ * 

4. Building teat should determine whether cr not a change should be made ln/the 
lnatructlonal priorities, based on assessment, results. 

5. Building team should decide which' objectives- will be given special attention 
immediately with short term remediation goals. 

Building team should decide which objectives will be given special attention 
as long term curriculum changes and Instructional program changes. 
7. Building team should share informal lan about meter ials and sources. Are 
all priority objective* covered? (List* where and how.) Are more resources 
needed? \ X 

ft. School teams ahould know whether or not they need "outside" aaalstance and 

what changes in Wrlculum materials and so forth are needed. 
9. Develop a plan to evaluete" effectiveness of planned changes. 
10. A timeline' should be developed. 
' 11. Follow-up reporting, •» needed , rhould also be put on a^mellne. 
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SUGGESTIONS FOR THE INITIAL RECOMMENDATIONS 
OF THE BUILDING TEAM 



I. Fo 



These recommendations are based upon a comparison of staff expectations 
and student' performance on the asseesnent tests. 



IV. 



Activity Coordinator: 



OBJECTIVE CODE/DESCRIPTION 



V. 




ACTIVITY PLAN 



Meeting Schedule: 
Participants: 

Activity: 



Expected Outcome: 



II. Meeting Schedule 

1. Length and number of meetings will, very depending upon sssigned task. 

2. Schedule s one hour organisational meeting (time, place, agenda). 

3. Subcquant see tings: discretion of participants. 



III. Participants 



1. 



2. 



Number and configuration will vary depending upon: 

a. staff sise 

b. organisational structure of Che school 

c. number and type of objectives identified, etc. 

Full staff involvement is recommended. (The total staf* need not be 
involved in all activities, but eech stsff member should participste 
in some espect of the utilisation process.) 
e. grade level grouping 

b. department grouping 

c. Interest grouping, etc. 



Activities 
1. 



Further dete analysis using the School Teet Icem Anelysls Report snd/or 
other available data. 

2. Integreting the objectives into the instructional program* by content eree. 

3. Focus Instructional program on the teaching of enabling skills that lend 
to attainment of objectives msasured by the tests. 

4. Develop or obtain materials and techniques to t^ach the ekllls that are 
not attained. 

5. Determine how objectlvee can be better teught in the future. 
Expected Outcome 

1, Curriculum review ami revision 

2. Instructional program ch a nges 

3, Selecting appropriate activities and materials 

4. tim lim end evalnttle* plea 0 
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SCHOOL PRIORITY LISTING 



Stepc for Coaplstiog Poraet: 

1. Place objectives in th« thrss cstegorles (Critical, laportciit, Useful) 
baaed epoe their laportance to school tool* and objectives. 

2. Vlthla each est* gory, prioritise the listed objectives. 



Reeding Objectives 



Crlticsl 



Iaportsnt 



Useful 



4 
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APPENDIX B-9" 



USIKG THE f TH 4 10TH GUAM WAP TESTS RESULTS 
(School Level) 



The /following' is a auggeated proceea which will provide a fMt and 
•My way for th« MAP Building to interpret HEAP cost results, draw 
initial implications, and awke recommendations by coaparing staff expec- 
tations and student performance. 



ANALYSIS PLOW CHART 



Exaalne staff expectations. Code objectives by grade 
level, on the analysis matrix, in terns of whe*e objec- 
tives are precclved to be introduced, nastarad or : 
reviewed. 



Set a realistic school criterion level of attainment, 

X. The level of sttalnnent st which sll students are 

expected to achieve on all objectives. 



Compere "expectation and performance by examining student 
performance shown on the School Summary Report. 



V 



Prioritise the objectives, identified as falling at or 
below the expected level of attainment in tarns of their 
Importance to school goals and objectives on Porn 2. 



Itake specific to commendations for Implementation to reach 
specific goals. Disseminata priority listing and 



:RLC 
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ANALYSIS MATRIX 



OH. SKILL AREA 4 \ 
CODE OBJECTIVE DESCRIPTION 1 


Gl 

Tl 


UD 
EffTI 


B8 

BD 

10 




OBJ. SKILL AREA k 
mm? nRjRPTiVE description 


GR 
TE 

A 


AD 

BT1 
7 


E8 

BD 
10 






- 






VOCABULARY MEANING 


















CRITICAL READING SKILLS 


f 
















IA Prefixes £ 


• 


• 


• 












MVA Author'! Purpose 


• 


• 


• 












IB Dafflm " 


• 
















IVB Fantasy/Reality 






• 












KJ Umph Meanings 


• 


• 


• 












IVC Author's Viewpoint 




• 


• 














• 


• 


• 


- 










RELATED STUDY SKILLS 


















IE A»toay«s 


• 


• 


• 












IP Context 


• 


• 


• 












VA Reference, Awareness 


• 


• 


• 












LITERAL. COM PREHENSION 

AM 4 Bp SMI w WMl Hfin an Dl 


















VB Reference, Use 


• 


• 


• 












VC Follow Directions 


















■ If A Fill to Blanks 
(Close procedure) 


















VD Summarising 


• 


• 


• 












ffll Main Mm 


• 


• 


• 












VE Outline 


















IIC Main Idea Details 


• 


• 


• 












VF Alphabetising 


• 


• 














»HD Recall 


















o 

POSITIVE RESPONSE/READING 




• 












• 


HE Saqaeaee 


• 


• 


• 












•BP Ceuee/Rtteejt 


• 


* 














IIG Ukeaeei/Differefre 


• 


• 


• 












VIA Read in Free Time 


• 


• 


• 












1IH Stnteaee Meaning 

(punctuation) 

Usi — , 


















VIB Visit Reading Places 


• 


• 


• 












VIC Request Extra Reading 


* 


• 


• 












INFERENTIAL COMPREHENSION 


















VID Talk About Reading 


• 


* 


• 












VIE Participate in 

Creative, Activities \^ 








» 











"MA Mum Idea 


• 


• 


• 












MB Ct»»VBIfc<t 


• 




• 












V 

% 

t 
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IIIC Probable Outcome 


• 


• 


• 












BID Mate Mm Details 


• 


# 


• 












HU iB^WbbJG 


• 


• 


• 












,Bg; Ubpa»VDtffcronco 






• 












JflG Csailasliai 


• 




* 












t 


• 


• 


• 














• 
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SUGGESTED WAYS OF 
SHAKING HEAP TEST RESULTS 
WITH SECONDARY STUDENTS 



In the upper grades, seventh end perticulerly tenth, where students 
ere tested, they My or any not have e Mathematics and/or a Reading class. 
It is therefore, necessary to arrange a direct link between the test results 
and students* The staff responsible for this linkage way vary, depending 
upon school organisation and structure. The following activities £.e & 
suggested to meet this need: 



1. Conduct test debriefing sessions with students in which they / 
can discuss and aak questions about the tests; 

2. Stimulate student interest in Mete resume by explaining how 
the results will be used and when they can be expected. 
(Example: publicise on school bulletin boards, through, the public 
addreas system, and/or the student news media.) 

3. Distribute actual results upon receipt. Allow students to examine 
and discuss their Individual Student Report. Student insight may 
prqye useful In* the d-^rgnostic process. 

4. It is Important to provide etudents with an explanation and 
Interpretation of their scores. Students are usually most 
concerned with whether they passed or failed*. It la .recommended, 
however » that "strong emphasis be pieced on explaining *the 
ekille a student has or has not learned" rather than tfce number 
of right and wrong responses* 



5. Provide encouragement and a suggested pled of action to address 
identified needs. 
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APPENDIX B-12 



lasted Ispltaentation Plan to Address 
identified Student Needs in Reading 



Student 



A. Results of HAP Data Analysis. 

I. Objectives not attained on HEAP 
(Circle all that apply): 

I*A I C D I F 
II ABCDEFGH 
III A1CDEFCHI 

IV tic 

V A B C D S F 



2. Areas in reading in which atudent le 
leant proficient: 



Vocabulary 

Literal Comprehension 
Inferential Comprehension 
Critical leading 
Study Skills 



I. Other Pertinent Available Data. , 
: 1. A list of reading services the, atudent la receiving: 



2. Reeulte jf other teat a and 
evaluation toole: 



Results 



3. Last grade received in these content 
areas : 



Social Studies 
Science 
English 
Mathematics 



(Other) 



C. Recoasended Program Plan. 

1. Schedule Planning Conference * 

a. Set date 

b. Identify participants (principal,/* 
counselor t reading consultant 9 
content area teachers * parent a 9 

^ and/or student (s). 

3. Select appropriate classes, acti- * 
vitlts, and/or Materials: 



2. Establish instructional goals for student 



a. 

b. 



4. Identify pereon(s) responsible for the 
program: 



APPENDIX C-l 

Rtportlng HEAP Results to Parents 
Staff Preparation 

I. Complete School Staff 

A. Review school results, total school staff, a team approach. 

B. Implement the "Model for mm liatlon of HEAP Test Results" to: 

1. Determine If curriculum or Instructional changes are needed. 

I. Formulate a plan of action-short term and lono tem-to share _ 
with the perent(s)--not necessarily operetlonal at the time of sharing 
school-wide, grade level, classroom, individual. 

II. Classroom Teacher of Students Tested 

. A. Be familiar with what Is tested, why 1t Is tested and how the results 
are reported. 

B. Review each student's results— highlight strengths and weaknesses- for 
discussion with the parcnt(s). 

C. Develop plans for needed remediation. Focus on wa*s to Involve the 
parentis), 1f possible. 

D. Review Classroom Listing Report. 

E. Select one/several priority objectives for the class and prepare 11st 
(Including why these skills were selected-objective attainment rates). 

F. Develop brief statement of Instructional plans and goals as these relate 
to the Instructional practices the selected priority objectives and other 
relevant Information. 
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APPENDIX C-2 

• . Reporting HEAP Results to Parents 

Model A 

Individual Parent/Teacher Conferences 
(MDE Recommended Method of Distribution) 

goals: 

1. To nrovlde the parent(s) with a better understanding of their child's 
strengths and Mealinesses In the basic skills of Reading and Mathematics. 

2. To provide the parent(s) with a ("Plan of Action" designed to address 
the Identified weaknesses. 

3. To solicit the assistance of the parent(s) In helping their child 
learn the skills needed. 

Material s t 

Classroom Listing Report (maintain confidentiality of other student's results) 
Individual Student Report 
Plan of Action (Class/Group/ Individual) 
Individualized Parent Pamphlet 
• NEAP Handbook 

List of Priority Objectives 

Time: Approximately 20-30 minutes 

» 

Participants : 

1. Classroom Teacher 

2. Parents 

<S .Process: 

1. Give a brief overview of the MEAP test: 

a. what Is tested (R & M) 

b. why the test Is given 

c. how the results are reported (I.e. by specific skills/objectives) 

d. what the results mean (1;e. Identification of strengths and needs) 

2. Use Information In the Parent Pamphlet to explain a child's specific 
strengths and weaknesses In skill areas tested. 

3. Use Individual Student Report, only 1f necessary, to further explain 
strengths and problems. 

4. Use MEAP Handbook to give examples of test Items and objectives. 

5. Indicate plans to remediate weaknesses (Involve'parent(s), If possible 
or desirable): ^ 

a. Indicate remediation teacher will provide In class. 

b. suggest plan of action parent can follow at home. 

6. 61 ve overview of areas of strengths and weaknesses of entire class/groups 
within class and related Instructional plans. 

7. Indicate fellow-tip teacher will provide to update the parent(s) on their 
ammam cnlld's progress and performance. 
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Reporting HEAP Results to Parents 
Model B 
Group PTA Meeting 



Goals: 

1. To provide the" parent(s) with a clear understanding of MEAP— why the 
' MEAP tests are given, what Is tested and how the results are reported. 

?. To discuss the overall Instructional plan and achievement goals for the 
school and specific grade levels as they relate to the MEAP test results 
(and other available Information, If possible). . . 

Materials : 

Film (optional): "Building Better Bas1cs--A HOme/School Partnership" 

(available from local REMC) 
Transparencies 

1. State Summary 

2. District Summary 

3. School S unwary 

4. Parent Pamphlet 
' Handouts 

Parent Pamphlet (Individual Student's) 
List of Priority Objectives for Grade Levels 

» 

Time: Approximately 1-2 hours 
Participants : 

1. School Instructional Staff (Principal, Teachers, Support Staff) 

2. Parents ' 

Process : 

1. Ask PTA to sponsor a Parents' Night (or have school host) with staff 
available to meet with the Individual parent(s) after a general 
presentation. 

2. Have school principal give overview' of MEAP testing program: 

a. what Is tested; 

b. why It's tested; and 

c. how the results are reported (for school & district, as well a« 
classroom and Individual). (Use transparencies #1, 2 and 3.) 

3. Have teachers given overview of areas of strengtns and weaknesses of 
entire grade level using List of Priority Objectives. 

4. Have teachers discuss Instructional plans and goals as they relate to 
Priority Objectives (and other available Information) 

5. Show parent film. 

6. Answer general questions. 



APPENDIX C-4 

7. Explain Parent Pamphlet. (Transparency #4) 

> 

8. Distribute Parent Pamphlet. ' v 

9. Have staff present (both counselors and teachers) to discuss Individual 
student results with the parent(s) as outlined In Model A, Individual 
Parent/Teacher Conference. 

10. Nail Parent Pamphlet to the parent(s) who did not attend, as described 
In Model C. 




\ 
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Reporting NEAP ftesults to Parents 

Mali to the Howe or Stnd Home with Student 
(Least Desirable Method of Distribution) 



teals: 



1. To provide the parent(s) with a better understanding of their child's 
strengths and weaknesses In the basic skills of Reading and Mathematics. 

2. To communicate the overall Instructional plan and achievement goals for 
the school and specific grade levels as they relate to the NEAP test 
results (and other available Information, If possible). 

3. To encourage the parent(s) to come to the school to discuss their, child's 
NEAP test results apd Instructional plans. T 

Materials: 



\ Cover Letter . 
Parent Pamphlet 

Tin; Mill vary depending upon preparation involved 



Participants: 

1. Mill vary depending upon dissemination source (teacher, counselor, principal, 
central office, etc.) 

2. Parents of Students Tested 

v - 

Process: 

1. Na1V or send heme with child, the Parent Pamphlet 
a. Prepare letter to accompany pamphlet 

1) prlef statement of what Is tested and why 

2) brief summary of ehnd'k strengths and weaknesses 

3) brief statement of remedlatl. .i plans % 

a) to be provided by teacher In classroom; and v 

b) plan of action parent can follow to assist student-et home. 

«) encourage the parent(s) to arrange a meeting with the teacher/ 
counselor to discuss their ch11d T s NEAP test results In greater 
dtpth* *tt * 

S) Indicate what follow-up will bo provided to apprise the parent(s) 
of their child's progress and performance. 
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, APPENDIX D-l 

REPORTING TO THE SCHOOL BOARD: 

I&eaa for Presenting MEAP 
to Local School Boards 



Edward D. Roeber 



INTRODUCTION K 

« f One of the Most imp or *nt audiences to which assessment resets 
are reported to is .the local school b^ard. Presenting test results to the 
school ioardSj 1 to ltfy citizens is a most important and challenging 
f activity. s The results must 'be reported simply and, clearly for under* 
standing. The reports "Should fully explain the assessiaftttl *m\ n yt the 
results in the context of other information about the schools, e g. , 

: - - * j . 

curricula emphases* resource allocations, as well^s, other 4 school out- 
put indicators. 

This guide haj been prepared to share some ideas regarding the 
types of .reports which can be made wO school boards. These li as should^/ 
be viewed as suggestions to build upon — they at* not the only ones which 
will work, nor will every one apply to or be needed by every school district. 
Special circumstances wil»l dictate 'special reporting. It is hoped that 
these suggestions will form the basis of your reporting program. The 
Assessment staff welcomes suggestions about other ideas that work. We'd 
like to pass these on in future editions of this publication.* 

BACKGROUNDING THE BOARD 

< « The tchool board members will have a wide range of knowledge about 

school outcomes, testing, and, more specif icelly, MEAP. A board b? ' flcg 

should provide enough information about MEAP and testing so members can spot J 

\ 
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inaccuracies and misinterpretations if thfey occur in published accounts of 
the results. MEAP has attempted to correct some of the misinterpretations of 
HEAP results that are printed in newspapers, but these attempts arc not always 
successful. Your board members usually are veil respected local leaders who 
can be very valuable in explaining the results in the community, and if need 
be 9 to correct misinformation. The board briefing is to prepare them for 
this role. 

How to prepare them? Adopt a t jchniqur * -at worka well with the 
news media — a background briefing. Schedule a fev inutes tp discuss testing 
without presenting the scores to distract them. This will allow you to discuss 
the purpose of the testing program independently of their natural concerns 
about whether the scores have improved or declined. The briefing will also 
provide an opportunity to discuss with the board what will be done with the r 
results, before the results are received and while there is still time to 
modify the plan as needed. 

\ 

m 

Preparing the Background Briefing Report 

There are several things to do in preparing for the background 

» 

briefing. First, It will be useful to have the basic facts about assessment 
written down, .sr uch things as number &t objectives, items, and so forth are 4 
not overly confusing. Second, describe the purpose of MEAP succinctly. A 
slide- tape presentation has been put together to help you do this. Although 
it covers how to report MEAP results, the presentation is particularly good 
for lay audiences utio need a "non-Jargon" explanation. The slide/ tepe is 
available on a limited loan basis by contacting the Assessment staf i at \ 
(517) 373-83f3. If this is not used, you My wish to use a Pareut Paaphlht 
(with data deleted) a« a good, sleels axplanatlon of the State assessment 
progtaa. 
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It nay also be useful to show the school board a fan of the teat 
Item*. The MAT Handbook containa a aection with sample teat Items. Theae 
Itema, which are not drawn from the actual teat, can be ueeful with the school 
board or other audlencea to give a flavor of the teat at each grade level. It 
■ay alao be informative to put together a thirty-Item teat drawn from each 
grade level to llluatrate how the Items become more complex from fourth to 
aeventh to tenth grade. 

Third, becauae aome boarda of education may not have experience In • 
looking at outcomes of schools or In distinguishing outcomea and inputs, It 
may be ueeful to review the materials shown In Appendix A before discussing 
output measure such aa NEAP with the board. The exercise shown can be uaed 
with a variety of audlencea to "test" the dlfferencea between Inputa and out- 
puts. Such an exerclae coulu be \»sed aa a spring board for a discussion of 
' how Input and outputa may or may not be related. Boarda of education are 
often intereated In thxa topic and discussing It before results are given 
may assist you in covering the topic completely. 

Fourth, be prepared to discuss what will be done with the reaults. 

i 

Since It la mostly the reaponalblllty of building principals and c 1 asaioom 

teachera to use the results, one effective strategy la to Involve several 

* 

teams of principals and classroom teachera to show how the reaults have 
been and will be used. This preeentatlon should focua on apthe use of 
£EAP results with the students (and parent a of student a) tested and b) the 
use of the results to review and modify the curricula In the areas teated. 
Thla will servd to focua the attention of the school board on the instruc- 
tional use of the results. 

Finally, the background briefing should conclude with ajxUecueelon 
of the district plan to report the reeulte (when will the achool board get 
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the dietrict-level and state- ltvel results; when will the aedia receive a 
rtport of the results?) and tc encourage buildings to use the results (how 
will principals and teachers be encouraged to use the results?). 

In sumaary, then, the background briefing for the school board should 
contain these parts: 

A. Introduction 

Be Description of Purpose of HEAP 
C« Factual Information About HUP 

D. School Building Presentations about Using Besults 

E. leporting and Use Plan for District 



Proserin* the laport of District Bsaulte 

The second of the three reports which each district should sake to 
their school beard is the report of the results* It is this report which 
is both the most difficult and yet Most interesting* This report is crucial 
in establishing what meaning a variety of audiences derive from the HEAP scores 
for the district, the building and individual students* This/Report of results 
to the board may also serve as the report of results to Jffie media, thereby 
increasing the importance of this report, ^ 

The results report should answer several basic questions: 

a. flow did *e do this year? 

b. Has reading and mathematics achievement improved 

over last year? 

c. If so, why? 

d. If mot; why not? 

e. What will be done to review and to use the results? 

It should be emphasised that school districts downplay comparisons between 
districts or between school buildings within their district. These comparisons 
mislead the school hoard and the public by Implication. The comparisons imply 
that districts or schools are being assessed in terms rf total inputs or pro- 
grams* The public Is also misled into thinking that disti ta or schools with 
higher scores have no problem areas or needs, while districts or schools with 
lower scoresjfcve nothing but problems end needs. Such comparisons too easily 
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get translated into succeee/feilure Judgment a of tha ant Ira achool 
prograa. 

It ia Important, in a report to tha board about HEAP to mention 
othar meaaures of achi e v em e n t f aa vail aa othar achool ou' comas. Thaaa 
include other teat raau.ca, number of graduatee gat ting a job or furthar 
education, n unbar of ^etudente qualifying for academic scholarship*, and 
so forth. To aaalat the reader chink of thaaa, a liet of other variables 
which could be included in the report of reaulta la shown in Appendix 1« 

Included in the report of reaulta should be a aectlon dealing 
with what will be done to review the reaulta and how the reaulta will be 
uaedc Thia part of the report will ahow the school board he* the reaulta 
will be uacd in the district. It also provides a Mechanism for at laaat 
one follow-up report later in tha achool yea*. 

The report of the raeulte should contain at laaat thaae eectlone* 
First, it la important to provide the reader with aome baalc informal! n 
about NEAP. Thia would include: 

a. that it la any a very-pupil teating program 

covering grades, 4, 7, end 10] 

b. Mathemetlca and leading ere tea fad; 

c. reaulta ere returned for studente* 

teacher a, achool a; 

d. school reaulta are ueed to make curriculum 

improvemen t a , while etudent results are 

ueed to help student a learn the skills misssd. / 

The next aectlon of the report will ahow tha teat reeulta of the 

dietrict. The moat underetandable numbers to preeent are the percentagee 

of etudente who attained more than three quartere of the objectives (Category 

4 on the proportiono report). These percentagea can be shown for this yeer 

versus the percentegea in previoue yeare* Thia will show changee in teet 

acores. 

, \ t 
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In addition, it may bn important to highlight ap^najor chanson 
la the performance of students on a for of the objectives • For example, 
if there have boon dramatic increasee on certain objectives, the chengee 
in, percentages of attainment can be Mentioned. This would be important to 
do if the building teams Have Identified and worked on certain key objectives. 
Ibis emphaeie could help to reward the extra effort by pointing out how the 
building teas effort has t&cceeded in improving student achievement. This 
any ba difficult to do in 1980 *i.:h tho changaa in the HEAP tents. 

If the performance of students has decreased significantly on certain 
objectives, this too li Important to acknowledge. While the reasons for the 
declines nay not be reed* ly known f these results say encourage a more detailed 
review to determine the causes. If so, these plana can be mentioned in the 
report, as well. * 

The next section of the report is the hardest end yet, perhaps, the 
most important. Once the program .has been described and the results p;e- 
eented, it is Important to describe the Impli^tlons of (he results. 
It is Important to answer the n eo what?" question clearly, concisely, and 

honestly. It may be hard for district* level staff to describe the Impli- 

* x 

cations of the results.-" It is therefore important to involve school-level 
etaff and administrators in e discussion of the implications. They have a 
first-hand knowledge of whet students have been taught and their capabilities, 
sad can describe tme implications of the results in more concrete terms * 
Teachers and curriculum specialists cm help add meaning to the district 
results by highlighting throe test iteme and objectivee which students 9 
performance 09 met or did not meet established expectations. Finally, eome 
summary statements about achievement level and change (s) over time should be 
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The final tact ion of the report of results should be the district 

short- and in t a mediate grange plans to use the results. This section can 

* & 

describe what various buildings plan to do with the results, as veil ar the 

district-level coordination of these efforts. In addition (whether or not 

the bfeard report serves as the public report to the news media) it would be 

a good idea to mention the district's plans to report the results to the 

media, to parents, and other citizens. 

♦ 

In summary, the report of results should contain these sections: 

A. Background About HEAP 

B. District tesults 

C. Interpretations of Results, 
0. Plana to Use Besults 

Y . : . • 

Follow-Up Impor ts 

Once the results have, been reported along with the plans for using 
the results, it lis only logical to report back t the board on the progress 
in using then. The following topics are suggested for follow-up reports 
and should be of Interest to the board: 1) specific areas of need selected 
as priority for review, 2) results of the curricula review process, 3) new 
Instruction contemplated as a result of the curriculum review, 4) planned 
follow-up testing of schools after remediation, and 5) special activities 
(awards, turner programs and so forth) planned as a result of testing. 

Sharing these follow-up reports with ths school board helps to 
point out that the educators are concerned about student achievement and 
are using test results to help students improve. It also halps the school 
board focus on the Instructional uses of HEAP and ds-emphasixe the 
"comparative 9 * uses of the results* \^ 

The follow-t* reports may be in writing only, ot may involve teachers 
ednipistratore, parents, or students presenting sons aspect of the prog ran. . 
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It is often useful to Involve others In the reports, since they can talk 
in realistic tens about the uses of test results and can factually 
answer board members' questions* 

In closing, the importance of reporting results quickly and 
accurately to the school board should be emphasised. The strategy suggested 
here consists of three parts: 1) a background briefing about purposes of 
HEAP and how results can be used, 2) a presentation of results, uses of % 

results in the district and implicatiu is of results, and 3) follow-up 

*j & 

reports that present specific ways results are being used. While this is 
not the only techniqdb which can be used to present results, it is effective 
in focusing the attention of the school board, educators and the community 
on the Inst rue tal uses of HEAP. This will help avoid the use of MEAP 
results for com* .ative purposes. Mort importantly, it will help assure 
that the HEAP results are used to help improv_ student achievement. 
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ON DISTINGUISHING OUTCOMES FROM INPUTS 

People usually judge schools on the basis of inputs, particularly the financial resources 
available to the school district. For example, school districts have frequently been ranked 
and given a *good" rating for having a relatively high per pupil expenditure, for paying 
higher than average salaries, and for hiring more employees per pupil relative to other 
schools. However, there 1s no guarantee that additional financial resources (Inputs) alone 
Mill necessarily produce better results 1n student learning (outcomes). In fact, appeals 
that have been made on the premise that additional funding will Improve educational quality 
have created a real dilemma for the schools. As financial support Increased, public expecta- 
tions also went up. But Instead of evidence of overall progress, the public Is confronted 
with reports of mixed results. Inputs do not measure how well a school is performing Its 
job and parents and citizens need to be encouraged to examine outcome Information as well 
as Input data when trying to come to Informed decisions about their schools. 

Unfortunately, the emphasis; on inputs, has been so great that 1t 1s often difficult for parents 
and citizens to see that there 1s another way to look at the schools. Because outcome data 
has not been as readily available and may be more difficult to Interpret than Input data, 
1t Is tempting to take the course of the least resistance. But 1t 1s Important for citizens, 
—school board members, and parents to focus on outcomes and to be able to recognize the 
^difference between Input and outcome measures. The following "exercises" are provided to 
Illustrate differences 1n judging a school on the basis of outcome and Input measures. 

An Exercise 1n Distinguishing Outcomes from Inputs 

Decide whether each statement 1s a measure of outcome (results of schooling) or a measure of 
input (that which 1s Invested 1n the school) and check the appropriate box. * 
< Outcomes I nputs 

1. The per pupil, general fund expenditure for Michvllle Schools 1s $1,420. L J I J 

2. Maria got one A, two B's, and two C's on her report card. [ ] l" ] 

3. M1chv1lle's new school has many teaching devices to aid in Instruction. [ ] [ ] 

4. Eighty-one percent of the fourth graders showed they could tell time by * £ -j [ ] 

accurately reading a clock. ** 

5. The pupils 1n Mr. Wojtowlcz' class showed a gain 1n spelling proficiency r j [ ] 

as measured by tests given at the beginning and the end of the year. 

6. The average pupil -.teacher ratio of Michvllle Elementary School 1s [ ] [ ] 

twenty- two pupils for each teacher. 

7. Michvllle* s seventh graders showed* 'mastery of whole number computation [ ] [ ] 

and non-mastery of computing with fractions. 

8. Otto's score on a standardized achievement test 1n mathematics Indicates — 

he did better than 55 percent of all other seventhVacaders who took L J L J 
the test. 
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ijut^td from Evaluating the educational Outcome s of Your Local Schools: A Manual for Parents 
g pjf i Citizens . Citizens Research council, 19797 P9.8-9 

(Available in limited quantities for the HEAP) 



PLANNING A REPORTING CAMPAIGN* 



School Events 
and Activities 



Accompanying Reporting Activities 



Person(s), 
Responsible 



Dates 



Start 



Completion 



A. Prior to Testing 

State Briefings 

Local Briefings 

Preparation for testing by 
Assessment Coordinators, 
teachers, students, and 
parents 



B. Tests Administered 



C, After Testing 

Results Distributed: 
District, school, classroom 
student, parent 
Results Reviewed:. 
Identify strengths 
Identify weaknesses ~ 
currlcular Implications 
(district, school, class- 
room) 

Instructional Implications 
develop plans to address 
weaknesses 



D. Preparation fortffext year's 
Testing 

Identify high priority objec- 
ts tlves (district, school) 

ERJC 



1. Press Release announcing MEAP test 
schedule and preparation activities 

2. District conmunl cations: 
to teachers 
to students 

. to parents of students tested 
to school board on purposes of MEAP 



1. Press Release announcing that testing 
1s 1n progress 



V. District conmunl cations about avail- 
ability of results and review processes 
2. Prepare reporting package(s): 

Identify Information of interest (more 
than just MEAP) 
Identify information available 
Decide reporting formats 
Decide reporting schedule 
tSchool Board Report (se£ Monograph # 5 ) 
•Report(s) to Media (see Monograph # 6) 
results and conclusions 
plans for further action 
actions taken 

exemplary activities (esp. those based 
on use of MEAP data and subsequent 
planning) 

•Parent Report(s) (See Monograph # 4 ) 
•Annual Report 

1. District communications to teachers, 
students, and parents about planning 
activities and procedures 
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School Events 
and Activities 



E. 



Identify performance expecta- 
tions (district, school) 

Identify procedures to be used 
to achieve expectations 



Evaluate the Reporting Campaign 
Identify strengths and weak- 
nesses 



F. Plan Next Reporting C&rpaign 
Contact media persons (sample?) 

determine Interests 

determine deadlines 
- Contact parents (sample?) 

determine Interests 
Contact teacher; (sample?) 

determine Interests 
Contact school board members 

determine Interests 



Accompanying Reporting Activities 



Press Release about planning in progress 
(could request community volunteers) 

Media articles about outcomes of plan- 
ning activities 

School hoard follow-up reports 



Contact audiences to determine reactions 
to campaign (samples): 
School board 
Media 
Parents 
Teachers 




Person (s) 
Responsible 



Dates 
Start {Completion 
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PLANNING A REPORTING CAMPAIGN 
Activity Timeline 



Re porting Activiti es 



1. 

2. 

3. 
4. 

5. 



Priss release announcing MEAP test schedule and 
preparation activities 

District communications to: teachers, students, 
parents of students tested, and school board 
rembers- 

Press release announcing testing in. progress 

ai lability 



7. 
8. 



uistrict communications (internal) u 
of results f id review processes 

Prepare rerfrtlng packages: 
School board report " 
Reports to media 

Parent report(s) ^ 
Annual raport 

District communications to teachers, students, 
and parents re. olajping activities and 
processes to prepare for next year's testing 

Press release re. planning activities in progress^ 

Media article (press) re. results of planning 
activities 



Sept, 



Oct. 



9. School boaru follow-up report 
10. 



11. 



RIC 



Contact audiencas of reporting campaign (samples.) 
to datermine reactions (school board, media, 
parents, teachers, etc.) 

Contact audiences of crcposeti reporting campaign 
to determine interests for next reporting campaign 



V 



Nov. 



Dec. 



Jan. 



Feb. 



Mar, 



Apr. 



May 



June 



July 



or 



PLANNING A REPORTING CAMPAIGN 
Conrnuni cation Analysis Chart— Audience Oriented 



WHO 


WHAT 


WHY 


HOW 


WHEN ■ 


t School Board 










• Media 




• 






e Parents of Students 
Tested 




: 






e A,H Parents 










e Co—mi ty Persons 










* Local Government 
Officials 










* Hvfc Groups 

* Chdtxh "Groups 




- 




- 


* School Groups 






> • 




a District Administrators 










e Building Administrators 










e Teachers of Students 
Tested 






T 




e All Teachers 










e Educational Associations 

And Unions 

•f IVi Ul II VI 19 


* 




i 




a Students Tested 










a All Stuoents 

• 
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